Web document classification using topic modeling based document ranking

In this paper, we propose a web document ranking method using topic modeling for effective information collection and classification. The proposed is applied to the technique avoid duplicated crawling when at high speed. Through technique, it feasible remove redundant documents, classify documents efficiently, confirm that crawler service running. enables rapid of many documents; user can search pages with constant data update efficiently. addition, efficiency retrieval be improved because new automatically classified transmitted. By expanding scope big based improving application various websites, expected more will possible.